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Recognition of 3-D Symmetric Objects from Range Images 
in Automated Assembly Tasks 

by 

Nicolas Alvertos* and Ivan D’Cunha** 

Abstract 

This research presents a new technique for the three-dimensional recognition of 
symmetric objects from range images. Beginning from the implicit representation of 
quadrics, a set of ten coefficients is determined for symmetric objects like spheres, 
cones, cylinders, ellipsoids and parallelepipeds. Instead of using these ten coefficients 
trying to fit them to smooth surfaces (patches) based on the traditional way of deter- 
mining curvatures, a new approach based on two-dimensional geometry is utilized. 
For each symmetric object a unique set of two-dimensional curves is obtained from the 
various angles at which the object is intersected with a plane. Utilizing the same ten 
coefficients obtained earlier and based on the discriminant method, each of these 
curves is classified as a parabola, a circle, an ellipse, or a hyperbola. Each symmetric 
object is found to possess a unique set of these two-dimensional curves whereby it can 
be differentiated from the others. In other words, it is shown that instead of using the 
three-dimensional discriminant which involves evaluation of the rank of its matrix, it is 
sufficient to utilize the two-dimensional discriminant which only requires three arith- 
metic operations. This approach seems to be more accurate and computationally inex- 
pensive compared to the traditional approaches. 


* Assistant Professor, Department of Electrical and Computer Engineering, 

Old Dominion University, Norfolk, Virginia 23529-0246. 

** Graduate Research Assistant, Department of Electrical and Computer Engineering, 
Old Dominion University, Norfolk, Virginia 23529-0246. 
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1. Introduction 


The rapid development of several active and passive range finding techniques has 
prompted range depth information to be a much more attractive data for the recogni- 
tion of three-dimensional objects. Location and description of 3-D objects from 
natural light images are often difficult to obtain. Range images on the other hand give 
a more detailed and direct geometric description of the shape of the 3-D object. 
Several techniques [1, 2] have been proposed to solve problems such as range image 
segmentation and description of three-dimensional surface patches. Most of these 
methods rely heavily on differential geometry of smooth surfaces and, in the process, 
evaluations of surface mean and gaussian curvatures. Though these approaches are 
long, they still come close to describing objects by means of several smooth surface 
patches. 

In this research we put forward an approach based on two-dimensional analytic 
geometry to recognize symmetric objects like cones, cylinders, spheres, ellipsoids, and 
parallelepipeds. After obtaining a set of ten coefficients [3] from the explicit represen- 
tation of quadrics, a series of 2-D curves are obtained from the intersection of planes 
at various orientations with the surfaces. Since the objects considered in this research 
are symmetric objects, it is observed that only two planes are sufficient to generate a 
unique set of curves distinguishing each object from the other. 

2. 3-D Discriminant 

In this section we will be summarizing a 3-D approach of classification and 
reduction of quadrics [4], which also looks into the various invariants of the quadratic 
form under translation and rotation of 3-D objects. 

A general second degree quadric equation can be represented as: 
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( 1 ) 


F(x,y,z) = ax 2 + by 2 + cz 2 + 2fyz + 2gzx + 2hxy + 2px + 2qy + 2rz + d = 0 
Define two matrices namely D and A such that 


D = 


a h g p 
h b f q 
g f c r 
[p q r dj 


and 


A = 


a h g 
h b f 

Lg f c 


Also let A, B, C, D, E, F, G, H, P, Q, and R denote the cofactors of a, b, c, d, f, g, h, 
p, q, and r respectively in the determinant A and a, p, y, <|>, £, 5 denote the cofactors of 
a, b, c, f, g, h respectively in the determinant D. 

It has been shown in [4] that I, J, D, and A, where I = a + b + c, J = a + p + y, D, 
and A the determinants, are invariant for any general coordinate transformation. Com- 

J I 2 D 

bining these four invariants a further set of three absolute invariants, I — , and I — 


is also obtained. 

Furthermore, based upon the ranks of the matrices A and D, the following 
classification has been deduced. 


Rank 

4 

3 

2 

1 

3 

Central quadric 

Cone 



2 

Paraboloid 

elliptic or hyperbolic cylinder 

plane-pair intersecting in a line 


1 


Parabolic cylinder 

parallel plane-pair 

Coincident plane-pair 
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3. Surface Characterization 

We will consider the representation and intersections (by two planes) of five sym- 
metric objects : the ellipsoid, the cylinder, the sphere, the cone and the parallelepiped. 
Assume that all the objects are resting on planes parallel to the yz plane and that their 
axis of rotation is parallel to any one axis of the coordinate axis. Then in relation to 
equation (1) the product terms, namely yz, xz, and xy will be missing. We will refer 
to plane 1 as the plane that intersects the object parallel to the yz-axis, i.e., x = con- 
stant. Also let us refer to plane 2 as the plane that intersects the object parallel to the 
xz-axis, i.e., y = constant. 

Consider the equation of an ellipsoid (spheroid) resting on a plane parallel to yz 
plane and its axis of revolution parallel to y-axis : 

Equation (1) reduces to the form 

F(x,y,z) = ax 2 + by 2 + az 2 + 2px + 2qy + 2rz + d = 0 (2) 

which further reduces to 


* 

2 

* 

2 

■ 

2 

x + £ 


y + £ 


r 

z + — 


a 


J b 


a 


T. i 



— + - 

= J 

— 


ill 

aba 

2 2-2 

only ifd=^- + -3- + 1 and also a > 0, b > 0 . 

aba 

Consider the intersection of the ellipsoid with plane 1, i.e., x 

— - a/^- < k < ^- + a/-^-, then, 
a v a a v a 


(3) 


k, where 


4 


- 1=0 


(4) 


(y + ^) 2 (z + f) 2 

b a 

— "V + 7 


1 (ak + p) 2 i 

w S 

ak + p 

T 

b ab a 

a 



which is the equation of an ellipse. 

Let’s now consider the intersection of the ellipsoid with plane 2, i.e., y=k, where 

: ?-VI <k< f‘ + 'VI' then ' 

(x + — ) 2 (z + — ) 2 

2 T + — -=--1 = 0 (5) 

1 (bk + g) 2 1 (bk + q) 2 

a ab a ab 

which is the equation of a circle. 

Next let’s consider the general representation of a cylinder resting on a plane 
parallel to yz plane and its axis of revolution parallel to x-axis. Equation (1) then 
reduces to 


F(x,y,z) = by 2 + bz 2 + 2qy + 2rz + d = 0 
which is the same as 


(6) 


F(x,y,z) = 



1 =0 


(7) 


2 -2 

only if d = -3- + — - 1 and also b > 0 . 
b b 

Intersection of the cylinder with the plane 1 would no longer affect its representation, 
since it is independent of the variable x. Hence the resultant curve intercepted is the 
same as represented by equation (7), which is a equation of a circle. 
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Consider the case where the cylinder is intersected with plane 2, i.e., y=k, where 

f--VI <k<: b- + VT' Then ’ 



Solving for z generates the equation of a pair of parallel lines. In the case where the 
cylinder is rotated in space, the representation of the cylinder will be of the form of 
equation (1). Proceeding as usual and intersecting with the two planes would generate 
curves which can then be recognized utilizing the approach shown in section 4. 

Let us consider the cone next. Again the general second degree equation for the cone, 
homogeneous in x, y, z, is 

F(x,y,z) = ax 2 + by 2 + cz 2 + 2fyz + 2gzx + 2hxy + 2px + 2qy + 2rz + d = 0 (9) 

However for a circular cone resting on a plane parallel to the yz plane and its axis of 
revolution parallel to the x-axis, the representation is 

F(x,y,z) = ax 2 + by 2 + bz 2 + 2px + 2qy + 2rz + d = 0 (10) 

where ab < 0, and also d = -2- + -3- + — . 

abb 

From equation (10), upon completing squares, we have 
• 12 r 12 r 12 

F(x,y,z) = a x + + b y + -§- + b z + -£- +d-^ — ^ — ■“• = () (11) 

v 3J a b b abb 

2 2 Jl 

Since d = + -3- + -L, equation (11) becomes : 

abb 
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F(x.y^) = - 


■ 

2 

■ 

2 

■ 

x + £ 


y+ -3- 


r 

Z + 

3 


J b 


b 

L - 1 

— + - 


— + - 



b 


]_ 

b 


= 0 


( 12 ) 


If a < 0, i.e., b > 0 , intersection of the cone represented by equation (12) with plane 

1, i.e., x = k, where ^ _ a/— < k c^, would generate 
a 'i a a 


■ 

2 

■ 

2 

■ 

2 

y+ -J- 


r 

z + — 


k + i 


7 b 


b 


3 


* 

— 4- - 

- ... 

= _ 

= - 1 




b 


(13) 


where is a positive quantity. The above equation is that of a circle. 

Intersection of the cone with plane 2, i.e., y = k, where - '\f^ < k < 
would generate 


■ 

2 

■ 

2 

■ 

x + £ 


r 

z + — 


k + -J 

3 


b 


b 


-1 

a 


b 


b 


(14) 


where is a positive quantity. The above equation is that of a hyperbola. 

3 

The sphere is considered next. Equation (1) for a sphere resting on a plane paral- 
lel to the yz-plane is of the form: 


F(x,y,z) = ax 2 + ay 2 + az 2 + 2px + 2qy + 2rz + d = 0 


(15) 


or 


F(x,y,z) = 


" 

2 

r i 

2 

■ 

2 

x+£ 


y + -3- 


r 

z + — 


3 


3 


3 


L J 


s 



— 


- 1-0 


(16) 


a 


a 
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only ifd=-£- + ^- + — -1 . 
aba 


Consider the case when the sphere is intersected with plane 1, i.e., x = k, where 

-2- - a/-^ < k < — + JT. Then, 
a ^a a ” a 


y + 


r 

z + — 
a 


1 

— s 
ak + p 

T + 

1 

r a 

ak + p 

a 

a 

i j 

a 

a 


- 1=0 


(17) 


which is the equation of a circle. 

A similar equation evolves when the sphere is intersected with plane 2, in which 
case y = k, where ^ - a/— < k < ^ + a/— , and subsequently equation (16) becomes: 

3 . ^ 3 3 ’ 3 


- 

2 

■ 

x + £ 


r 

z + — 

a 


a 



J 

7 S 

T + 

J 

7 ^ 

T 

i _ 

ak + q 

J_ _ 

ak + q 


a 

a 

V. J 

a 

a 

< J 



(18) 


which again represents a circle. 

The next object considered is a parallelepiped. Since planar surfaces cannot be 
represented with quadratic equations, we consider a plane of the parallelepiped. 

The general equation of a plane from equation (1) is of the form 


2px + 2qy + 2rz + d = 0 (19) 

Intersection with plane 1, i.e., x = k, will generate 

2qy + 2rz + d + 2pk = 0 (20) 

which is the equation of a line. 


8 



Similarly, intersection of the above plane with plane 2 would generate the line 


2px + 2rz + d + 2qk = 0 (21) 

Following up from the ellipsoid to the parallelepiped, we see that a unique set of 
curves has been obtained for each of the surfaces using just two planes. The table 
below summarizes the above results. 


object : plane 

Ellipsoid 

Cylinder 

Cone 

Sphere 

Parallelepiped 

X 

II 

ellipse 

|g§H 



line 

!■ 

circle 

line 

hyperbola 

circle 

line 


4. 2-D Discriminant 

Once a unique set of 2-D curves has been obtained for each 3-D surface, the next 
objective is to recognize each of these 2-D curves based upon the available 
coefficients. 

Given a conic of the form 

F(x,y) = Ax 2 + Bxy + Cy 2 + Dx + Ey + F = 0 (22) 

the measure B 2 - 4 AC discriminates the curves as one of the following [5] : 

If B 2 - 4AC < 0, then the conic is an ellipse or a circle. 

If B 2 - 4 AC = 0, then the conic is a parabola. 

If B 2 - 4AC > 0, then the conic is a hyperbola. 

Although two planes were sufficient enough to distinguish each of the above five 
objects from the other, a more indepth analysis of intersection of objects with planes at 
different orientations, evolves a variety of curves for each of the object. A cylinder 


9 















for example will generate curves like the parabola, ellipse along with circle and lines 
generated above, when intersected with planes at different angular orientations. A 
cone generates curves like parabolas, ellipses, circles, hyperbolas and isosceles triangle 
when intersected with planes at varying orientations. The angular bounds for which a 
plane intersecting a surface results into the same 2-D curve must also be investigated. 

5. Determining the 3-D Coefficients 

In this section, we will briefly present the generation of the ten coefficients which 
describe 3-D surfaces [3]. The second degree quadric equation as before is 
represented by 

F(x,y,z) = ax 2 + by 2 + cz 2 + 2fyz + 2gzx + 2hxy + 2px + 2qy + 2rz + d = 0 (23) 

Our aim is to obtain a surface which best fits the given set of range data. This 
surface will have the least mean squared error measure for the given data points. 
Hence it remains to be determined which ten coefficients that describe a quadric sur- 
face so as to render the least mean squared error measure. Equation (23) in vector 
notation will become 


F(x,y,z) = a T p = 0 (24) 

where a T = [ a b c 2f 2g 2h 2p 2q 2r d ] and p = [ x 2 y 2 z 2 yz zx xy x y z 1 ] . 

The error measure for any data point (x, y, z) can be measured by substituting in 
F(x, y, z). If this point lies exactly on the surface then, F(x, y, z) = 0 , meaning that 
the error is zero. 

The mean squared error then is given as 

E = min£llFll 2 (25) 

* s 


10 


In vector notation, we have 


E = min £a T pp T a = min a T Ra (26) 

8 s * 


where R is the scatter matrix for the data set equal to 


R = XPP T ( 27 > 

S 

Minimizing E would lead to a trivial solution of a and hence using Lagrange’s method, 
a new function 


U = G(a) - XK(a), (28) 

with an undetermined constant X and a constraint K evolves. Solving and K(a)= k 

simultaneously, we find a and X to give a minimum solution. Groshong and Bilbro [3] 
give a detailed analysis for the derivation of the constraint matrix K. Using their 
results directly gives, 


K = 


K 2 0 
0 0 


where the constraint matrix 


(29) 


k 2 = 


1 0 0 0 0 0 

0 1 0 0 0 0 

0 0 1 0 0 0 

0 0 0 1/2 0 0 

0 0 0 0 1/2 0 

0 0 0 0 0 1/2 


(30) 


Further as in [3] the coefficient vector ai corresponding to the least eigenvalue X, 


for the minimum error solution for the given data is obtained. 
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6. Experimental Results and Conclusions 

For experimental purposes, range image data of a sphere and a cylinder were con- 
sidered. The raw data of both the sphere and cylinder images were noisy (salt and 
pepper noise). Median filters of mask sizes 3x3 and 5x5 were used to remove the 
noise and the effect of these filters on the range data was studied. Figure 1 shows the 
raw image of the sphere. Figure 2 is the 5x5 filtered image of figure 1. Similarly 
figures 3 and 4 are the corresponding images for a cylinder. For each set of the raw 
data and the processed images, the ten coefficients were obtained. 

Each of the processed images of both the sphere and the cylinder were intersected with 
the two planes (one parallel to yz-plane, the other parallel to xz-plane). The results 
obtained for the sphere are tabulated below. 


Sphere Images 

Raw 

3x3 filt. 

5x5 filt. 

plane 1, x = k 

Ellipse 

Ellipse 

Circle 

plane 2, y = k 

Ellipse 

Ellipse 

Circle 


A decision on the curve being an ellipse or a circle was made based upon parity and 
the disparity of the x 2 , y 2 , and the z 2 coefficients. 

Experiments conducted with the raw and the processed images of the cylinder led 
to the following results. 


Cylinder Images 

Raw 

3 x 3 filt. 

5x5 filt. 

plane 1, x = k 

Ellipse 

Line or Ellipse 

Line 

plane 2, y = k 

Ellipse 

Ellipse 

Ellipse 


As seen form the tabulated results, the raw images come close in generating the 
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desired curves for each of the objects, but at the same time a 5 x 5 filter in either case 
generates the exact 2-D curves. 

In this research we have put forward a new technique to recognize symmetric 
three dimensional range objects. The intersection of a set of planes with each of the 
objects results in a unique set of two-dimensional curves, which is sufficient enough to 
discriminate each from the other. In the future research, work will be concentrated on 
recognizing a bigger set of three dimensional objects like the paraboloids, the hyper- 
boloids of one and two sheet and several other useful 3-D objects. Work will also be 
directed towards the determination of the bounds through which each object yields a 
unique set of curves. 
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